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1 )S Responsive to communication(s) filed on 02 April 2007 , 
2a)l3 This action is FINAL. 2b)n This action is non-final. 
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Application Papers 
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DETAILED ACTION 

Response ti? Argument 

1. Applicant's arguments with respect to claims 1*45 have been considered but 
are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC§ 103 

2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as 
set forth in section 102 of this title, if the differences between the subject matter sought to be 
patented and the prior art are such that the subject matter as a whole would have been obvious at 
the time the invention was made to a person having ordinary skill in the art to which said subject 
matter pertains. Patentability shall not be negatived by the manner in which the invention was 
made. 

3. Claims 1-45 aie rejected under 35 U.S.C. 103(a) as being unpatentable over 
Bnn (US 2003/0001890 Al) Baker (XiS 5,686,957) and Aoki etaliUS 2004/0172252 
Al). 

Claims 1, 22 and 34: 

Brin discloses a system and method for interactive communication among a 
plurality of users. Brin teaches that the system enables users to perceive and 
participate in a multiple real-world conversational characteristics, such as 
proximity and orientation of a listener, emphasis by a speaker, importance of a 
speaker, reputation of a speaker, filtering conversations, etc. The system detects 
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multiple communication interactions among the individuals present in the 
environment and maintain an interest thread for each communication interaction 
(abstract; p. 1, par. 0011-p, 2; par. 0012-0019, 0028; p. 3, par. 0033). The system 
captures a set of media data for each interest thread and combines it in response to 
the activities of a subset of the individuals associated with the interest thread (p. 4, 
par. 0065-0069, 0074-0075; p. 5, par. 0076-0082; figs. 5, 7, 14, 15). 

Brin does not teach a first and second sets of sensing and rendering 
components that cover the physical movements of multiple individuals present in 
respective first and second environments. However, Baker discloses a 
teleconferencing system having a first set of sensing and rendering components 
(microphones, video cameras, computers, etc.) that cover the voice and physical 
movements of a plurality of participants present in a first environment; and a 
second set of sensing and rendering components that cover the voice and physical 
movements of a plurality of participants present in a second environment (abstract; 
col. 1, lines 16-30; col. 7, lines 1-25). The system has components that detect the 
sound of a participant speaking and components that detect the movement or 
gestures of the speaker (coL 5, lines 9-67; col. 6, lines 1-67). The system has an 
interest thread detector that detects communication interactions involving one or 
more participants (col. 1, lines 16-30; col. 5, lines 9*13, 16-67; col. 6, lines 167). The 
system has a communication provider that captures the media data, combines the 
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captured media data and communicates the combined media data to the rendering 
components (col. 9, lines 14-67; col. 10, lines 10-36). Therefore, it would have been 
obvious to one ordinarily skilled in the art at the time the invention was made to 
modify Brin's interactive communication system to include Baker's teaching of 
using a plurality of sensing and rendering components to capture the audio and 
movements of a group of participants in a teleconferencing environment because as 
Baker says, manual manipulation of multiple video cameras and other components 
is labor intensive and using a set of sensing and rendering components around a 
conference table is much more efficient for video image capture of surrounding 
selected participants. 

Brin/Baker does not teach detecting and maintaining an interest thread for 
each detected communication interaction and combining captured media data in 
response to respective activities of each individual involved in the respective 
multiple communication interactions of individuals present in an environment. 
However, Aoki discloses a system and method for identifying conversations among 
multiple users. Aoki teaches detecting multiple communication interactions and 
maintaining interest threads for each detected communication interaction (p. 1, par. 
0011, 0012; p. 2, par. 0032-0034; p. 3, par. 0041-0047, 0049; p. 5, par. 0064, 0068- 
0071; p. 8, par. 0101; p. 13, par. 0166, 0167). Therefore, it would have been obvious 
to a person having ordinary skill in the art at the time the invention was made to 
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modify Brin/Baker's interactive communication system to include Aoki's teaching of 
combining captured media data in response to the users' respective activities 
because as Aoki explains, meetings have groups and subgroups of people carrying 
on separate conversations and each subgroup maintains a conversational floor, and 
by detecting, maintaining and combining multiple captured media data, the system 
enables multiple people to participate and maintain a conversational floor, while at 
the same time each member/subgroup can maintain awareness of the primary 
group conversation. 
Claims 2, 23 and 35: 

See claim 1. Brin teaches selection of a subset of sensing and rendering 
components for use for each interest thread (p. 4, par. 0065-0069, 0074-0075; p. 5, 
par. 0076-0082; figs. 5, 7, 14, 15). 
Claims 3, 24 and 36: 

Brin teaches speech levels of the individuals (p. 2, par. 0012-0019). 
Claims 4, 25 and 37: 

Brin teaches selective filtering based on emphasis expressed by other 
speakers. Brin teaches emphasis such as gesturing (p. 5, par. 0076). 
Claims 5. 18-20. 26 and 38: 

Brin teaches activities including movements by the individuals (p. 2, par. 
0019, 0021, 0032; p. 5, par. 0080, 0083; p. 8, par. 0111). 
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Claims 6. 27 and 39: 

Brin teaches activities including locations of the individuals (p. 6, par. 0094). 
Claims 7. 28 and 40: 

Brin teaches that the system refines the media data in response to the 
activities of the individuals (p. 2, par. 0013-0026, 0031, 0034). 
Claims 8. 29 and 41: 

Brin teaches history of the communication interactions (p. 11, par. 0157; p. 
12, par. 0172). 
Claim 9: 

Brin teaches communication interaction pertaining to an artifact in the rich 
media environment (p. 2, par. 0018; p. 3, par. 0037-0038). 
Claims 10-13. 30. 31. 42 and 43: 

Brin teaches that the system keeps track of each user's entry, which is 
displayed in conversation display spaces (writing surfaces) and updated with every 
entry (records a history of the space's content over time), (figs. 4B, 5A, 5B; p. 7, par. 
0099-0108). 

Claims 14. 15. 32. 33. 44 and 45: 

See claim 1. Brin teaches detection of multiple activities (audio, gestures, 
movement, etc.) and creation of interest areas for each detected activity (p. 5, par. 
0076; p. 7, par. 0099-0108; figs. 5A-.10). 
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Claims 16 and 17: 

See claim 1. Brin teaches communication interactions among two or more 
individuals in two or more of the rich media environments (p. 16, par. 0241; figs. 
5A-10, 14, 15). 
Claim 21: 

See claim 1. Brin teaches one or more individuals in remote locations (p. 1, 
par. 0004-0006). 

Conduaion 

4. Applicant's amendment necessitated the new ground(s) of rejection presented 
in this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire 
THREE MONTHS from the mailing date of this action. In the event a first reply is 
filed within TWO MONTHS of the mailing date of this final action and the advisory 
action is not mailed until after the end of the THREE -MONTH shortened statutory 
period, then the shortened statutory period will expire on the date the advisory 
action is mailed, and any extension fee pursuant to 37 CFR 1.136(a) will be 
calculated from the mailing date of the advisory action. In no event, however, will 
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the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

5. Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to X. L. Bautista whose telephone number is (571) 
272-4132. The examiner can normally be reached on Monday-Thursday 8:00AM- 



If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, Weilun Lo can be reached on (571) 272-4847. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. ^ /On 



6:00PM. 



X. L. Bautista^.^]!!^ 
Primary Examiner 
Art Unit 2179 




xlb 

June 21, 2007 



